AI as Longterm Memory

The current state-of-the-art Gemini model can fit roughly 1.5 million words in its context. That’s enough for me to upload the full text of all fourteen of my books, plus every article, blog post, or interview I’ve ever published—and the entirety of my collection of research notes that I’ve compiled over the years. The Gemini team has announced plans for a model that could hold more than 7 million words in its short-term memory. That’s enough to fit everything I’ve ever written, p...

 Quantifying Information Content Does Not Bring Meaning Fr...

It is perfectly true that redundancy aids recognition of a signal as a language or a code, and this recognition is crucial to SETI. However, Shannon’s method provides only a quantitative measure of the complexity of a language or signaling system—not a translation. And while it is axiomatic in cryptology that redundancy helps in deciphering a text, the task of decipherment/cryptanalysis is to move from an encoded text to the original text—not from text to meaning. To get from text to me...

 Another way of looking at "flow" is to call it "non-conte...

As the gamer becomes attuned to the game, they become one event, one action; an oscillating between the line dividing self from other, and the line connecting them as one substance. If the line dividing provides a moment of autonomous self; the line connecting provides a moment of selfless purpose. In games, action has its limits. It is an endless bit-flip between targeter, targeting and target. And yet at least it effects a transformation of gamer and game. Games are a repository for a certa...

 Digital Allegorithm of Sisyphus

Digital object, digital subject — these are byproducts of a boredom that, seeking respite from nothingness, projects its lines across all space and time, turning it into commodity space and military space. This is the reckless act of creation with which Katamari Damacy begins — the King’s destruction of the mythic heaven of the old Gods, and the project of replacing it by commanding the transformation of a human, analog movement into an airless matrix of machine code. This is the new la...

 The Digital is All About Boundaries

The digital is all about boundaries. The digital does not follow a moving line, it imposes a grid of lines which produce a series of boundaries. In the analog, difference is the productivity in excess of itself; in the digital, difference is a negation that comes from without. Roll the ball as much as you like, but unless it reaches the size King Digital demands within the time He allows, you fail — and are subjected to His lofty disdain. The analog is variation along a line, a difference ...

 Abstractions Turned Obfuscations

There is an old saying in Silicon Valley, “There is the first 80% and the second 80%.” While it is really hard to create new technologies, it is also really hard to implement them for any measurable advantage. This has always been true: The steam engine didn’t matter until it was put into a ship and locomotive; the Wright brothers’ flight didn’t matter until it moved people; electricity needed to be delivered to the home; and telephony didn’t matter un...

 Immersion in the Simulation Makes it Hard to Question It

Individuals become immersed in the beauty and coherency of simulation; indeed simulations are built to capture us in exactly this way. A thirteen- year- old caught up in SimCity, a game which asks its users to play the role of urban developers, told me that among her "Top Ten Rules of Sim" was rule number 6: "Raising taxes leads to riots." And she thought that this was not only a rule of the game but a rule in life.3 What may charm in this story becomes troubling when professionals lose thems...

 Computers are Associated with Precision, but Really They ...

In physics, too, where computers were used to relieve the tedium of data collection and plotting, relatively mundane applications had significant effects. When calculation was automated and its results instantaneously translated into screen visualizations, patterns in data became more apparent. Physics students described feeling “closer to science” and “closer to theory” when their laboratory classes began to use software for visualization and analysis. As in chemistry...

 What Will be Left After the AI Bubble Pops?

Every bubble pops eventually. When this one goes, what will be left behind? Well, there will be little models – Hugging Face, Llama, etc – that run on commodity hardware. The people who are learning to “prompt engineer” these “toy models” have gotten far more out of them than even their makers imagined possible. They will continue to eke out new marginal gains from these little models, possibly enough to satisfy most of those low-stakes, low-dollar ap­...